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System Development 


Kennedy Space Center 



Soft Computing (SC): 

differs from conventional (hard) computing in that, unlike hard 

computing f it is tolerant of imprecision, uncertainty, partial truth, and 
approximation. 


provides flexible information processing to handle real life ambiguous 
situations and achieve tractability, robustness, low solution cost, and close 


resemblance oHiurnan decision niaking . 
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System Development 
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FRED (Fuzzy_ Reasoning Edge Detectionjp 

Image edge extraction technique developed at KSC (patent protected). 

FRAT (Fuzzy Reasoning Adaptive Thresholding ): 

1 

Image binarization technique developed at KSC (patent protected). 

Set of Image Enhancemej it Techni^uesj 
Techniques developed at KSC (one patent protected). 

Visual/Patte m Recognition 

Commercially available technique (NeuroShell) via Artificial Neural 

Network (ANN) and GA (Genetic Algorithm). 
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Software implementation. 


ennedy Space Center 


ANSI C Code. 

C Code currently “wrapped” and embedded into a portable I/O 
image operator created using WIT (Logical Vision, Inc.), a 
commercially available image processing software. 


Operator has one input (original image) and two outputs, the 
binarized image and the optimal threshold value. 
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Software implementation ( Cont) 
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name: Boxes 
display #2 


display 


Original image 


KscThreshLin' 


counlerl 


name: Mo*ion1to2 
wrtelmage 


Threshold Value 


display #3 


C yfcwHstogramEntrqpy 


Out Type grayscak 
ErodeDepth: 0 
ComblneOist: 2 
DeteteSmaHSize: 0 
DeleteEdgeDist. 2 
DilaleDepth: 2 


HistOain: 0.0125 
ErrtropyLinGain: 0.. 
EntropyLogGain. 0. 




Bates 




WIT 7.2 Igraph: MotlonTestTrajectoriesDIsplay 


FRAT algorithm coded in C and “ wrapped " 
under an I/O operator and named KSCThreslin 


Binarized image 











Original Image: CD containing a hard-to- 
see major scratch on the center 


FRED: The major scratch is clearly 
shown as well as other minor ones 
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Prewit Approach: less clear feature 

major scratch invisible Wv 
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Performance results compared with existing appi oaches. FRED 
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Sobel Approach: less clear features, major 
scratch invisible 
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New Method 
CPU time: 2.0 ms 
Threshold: 8 


Mk. 


Performance results compared with existing approaches: FRAT 
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Original 8-bit Image 
Size: 246*245 


Otsu’s Method 
CPU time: 1 .5 ms 
Threshold: 88 


Huang- Wang Method 
CPU time: 10.8 ms 
Threshold: 89 


Then, just si 
little south r 
you’ll likely ' 
of intornctin 
entry in Clin 
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NASA Applications 
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Real-Time (RT) Anomaly Detection. 
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RT Anomaly Detection 


nnedy Space Center 



Image Preprocessing . 
Enhancement 
Segmentation (Binarization) 



Classification and Learning Processes . 
Artificial Neural Network (ANN) 
Genetic Algorithm (GA). 




Anomalies on the basket slidewjre 
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Molten spots caused by lighting. 
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RT Anomaly Detection 

Kennedy Space Center 


Astronauts training on the emergency egress system. 
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RT Anomaly Detection (Cont.) 
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'Cable and Line Inspection Mechanism (CLIM) 


..! rphe National Acronmitk* and Space Administration 
1 (NASA) vtkl to transfer the NASA developed Cable 
and Line Inspection Mechanism technology to private 
industry for uw in commercial application*. This mecha- 
nism was developed at the John P. Kennedy Space Center 
(KSC) to provide a mean* for automated inspection of 
the seven slldewire cable* used in the emergency egress 
system for the Space Shuttle. There am two *u of 
gantry cables plus an overhead lightning cable that require 
periodic inspection. Tlicsc cables are nonfemius stainless 
steel; therefore, magnetic cable testers are not suitable for 
such inspection*. Prior to this invention, cable Inspections 
required 150 man-hours twice per year, with inspector* 
being hoisted In baskets to manually inspect the cables by 


direct touch ami sight The CUM technology eliminates 
the hazardous, manpower-intensive. and time-consuming 
methods previously required to maintain the emergency 
egress system at peak performance standard* In addition. 
CUM Is capable of Inspecting the top end or ferrous 
wire ropes near the attachment point in the cable housing 
where magnetic cable tester* are unable to reach. CUM 
ha* a further application with respect to radio frequency 
(RF) tower guy-wire inspections. Tbc lowcwbon, low- 
magnetic inductance of the stainlew-stccl guy-wire cables, 
combined with added RP radiation interference from the 
tower, yields magnetic cable testers ineffective. Therefore. 
CUM’* ability to conduct a 360-degree view of the cable 
without incurring RF radiation interference is significant. 


CUM at the lab. 


CLIM at the Shuttle Pad 


Slidewire image acquired by CUM 


National Aeronautics and Space Administration 
John F. Kennedy Spaec Center, FL 




Cable & Line Inspection Mechanism (CLIM) built by NASA. 




j 


181138 


i 

i 




RT Anomaly Detection (Cont.) 
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Background Extraction + FRED 





Binarization via FRAT 



Blob anal 




Anomaly Detection via ANN-GA engine (output) 
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RT Anomaly Detection (Cont.) 
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End-user front 
end built via 
MFC. 


Main Menu 
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✓ A1 (Magenta) 
v A2 . iCyan) 

V A3 (UYellow) 
A4 (LtMagenta) 
A5 . (UCyan) . 
AG (WWe) 

| A7 (White) 

AO (White) 

A9 fWtrte) 


RT Anomaly Detection (Cont.) 
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End-user front 
end built via 
MFC. 


Training Stage. 
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RT Anomaly Detection (Cont.) 


Space Center 
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NcuroShell Classifier - Trained Network Information 


Network filename: C:\sessions\data\session11\session11G3.net 

The network was trained on: 

Filename: C:\sessions\data\session1 1\session1 1.dat 

Total data rows: 798 

Training rows: 798 

Start row: 1 

End row: 798 


Results of training session: 

Training time: 1:20:16" 

Generations trained: 178 

Correct classifications: 98.87% (789 of 798) 

Incorrect classifications: 1 . 1 3% (9 of 798) 
Performance by category: 

"0" 90.48% (38 of 42) 

"10" 99.34% (751 of 758) 


Network structure : 


Training strategy: Genetic 
Output name: "Class" 

Number of inputs. 13 
List of inputs and their relative importance: 

"ContrastO" 0.006 

"Contrastl" 0.163 

*AngMom20" 0.074 

"AngMom21" 0.018 

"MeanValQ" 0.018 

"MeanVall" 0.074 

"HomogenO" 0.095 

"Homogenl" 0.045 

"EntropyO" 0.184 

"Entropy 1" 0.01 

"FormFacT 0.094 

"Angle" 0.115 

"Edginess” 0.106 
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Development of 
classification 
model via ANN & 
GA (NeuroShell) 
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RT Anomaly Detection (Cont.) 
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Anomaly Detected 
& displayed in R T. 


Firing stage 
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RT Anomaly Detection (Cont.) 
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Automated Region of Interest (ROI) 
extraction and anomaly detection. 




RT Moving FOD Detection 
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. Blob Generation (single image) . 
Segmentation (Binarization) 


Blob/FOD Selection and Trajectory Computation 
Logical path analysis (consecutive images). 




RT Moving FOD Detection (Cont.) 
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RT Moving FOD Detection (Cont.) 
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Columbia Investigation 
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Foam Debris 



D : Detection & Location . 

Segmentation (Binarization) 



Characterization (center of mass, borders, etc.) 

Pgr., ' 

Bsp, 

; Location & Trajectory 

Optimal path at three consecutive 3D projections. 
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Columbia Investigation 


Kennedy Space Center 


STS-107 REPORT: 

2D-Detection, 3D-Location & 3D-Velocity Estimation of 
Foam Debris Based on Images acquired by E212 & E208 

Video Cameras. 
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Jesus A. Dominguez, ASRC Aerospace Corp. 
NASA Kennedy Space Center, June 12, 2003 


Columbia Investigation: 

Foam Debris Detection/Location ( Cont.) 
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E212 at 21.769 s 
Optimized path. 




Columbia Investigation: 

Foam Debris Detection/Location (Cont.) 
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E2 12 at 21.722 s 


ET208 at 21.724 s 


E212 at 21.738 s 


Optimal Dcbiii Path 
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E212 at 21.722 s 
ET208 at 21.724 s 


fe 212 at 21.738 s 
Optimized path. 
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Columbia Investigation: 

Foam Debris Detection/Location (Cont.) 
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E212 at 21.753 s 


ET208 at 21.757 s 


E212 at 21.769 s 


ID Cofwxcbng Distance 


Optimal Dcbri* Path 
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E212 at 21.753 s 
ET208 at 21.757 s 


E212 at 21.769 s 
Optimized path. 



Columbia Investigation: 

Foam Debris Detection/Location (Cont.) 
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ET208 at 21.791 s 


Optimal Dcbm Path 


E212 at 21.800 s 
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E212 at 21.784 s 
ET208 at 21.791 s 


E212 at 21.800 s 
Optimized path. 


Columbia Investigation: _ 

Foam Debris Detection/Location (Cont.) /^Vv 
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E212 at 21.831 s 
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E212 at 21.816 s 
ET208 at 21.824 s 


E212 at 21.831 s 
Optimized path. 
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Columbia Investigation: 
Foam Debris Trajectory 
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Current Work 


Lane-Nelson work via LighWave3D 
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Columbia Investigation: 
Foam Debris Trajectory 



Lane-Nelson work via LighWave3D 
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Columbia Investigation: 
Foam Debris Velocity 

ennedy Space Center ____ 


3D Velocity Estimation 
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21.65 


21.70 
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Time (s) 
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Current Work 4 Lane-Nelson Work (via LighWave3D) 
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Proposed Debris Analysis Software 
System Development at KSC 


Kennedy Space Center 


Automated Debris Detection at KSC VAB Launch Analysis Laboratory 





/ Jfcr# Microsoft 

ml Windows 

Current OS housing FRAT, 
FRED, SC-based image 
pattern recognition. 



VAB Launch Analysis Laboratory at 
KSC equipped with recently acquired 
SGI Reality Center facility with a 7 - 
foot display, and advanced SGI 
TP9500 data management 
subsystem. 
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Commercialization: Licensing 
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Patent 
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NASA KSC 


NASA Technology 


Kirsten Rieth 


Phone: (919) 967-4991 
Fax: (919)541-6221 

Email: krieth@rti.org 



Technology Marketing 

BRTI 

IBTfcHNATIOWAL 

Research Triangle Institute (RTI) 
Center for Technology Applications 
PO Box 12194, 3040 Cornwallis 
Research Triangle Park, NC 27709 

Applications Team: 

John Geikler 

Phone: (919)941-8372 

Fax: (919)941-8399 

Email: johng@thesolutioncenter.com 
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Binarization of Noisy Images 

4 fuiiy Ressoning Method 
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Catalog 
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Figure 9 




Commercialization (Cont.) 
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http://nasa.rti. org/ksc/imaging 
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Figure 8 



Commercialization ( Cont.) 
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©Detecting Edge* in InUf f S hy Use of 
Fuzzy Reasoning 
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Commercialization (Cont.) 
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http://www.cte.rt.xli/Wo/lA _S20CM.htmJ 
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Commercialization (Cont.) 
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Commercialization (Cont.) 
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